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Summary. In this paper a vision-based vehicles recognition method is presented. 
' Proposed method uses fuzzy description of image segments for automatic recogni- 

tion of vehicles recorded in image data. The description takes into account selected 
geometrical properties and shape coefficients determined for segments of reference 

> image (vehicle model) . The proposed method was implemented using reasoning sys- 
tem with fuzzy rules. A vehicles recognition algorithm was developed based on the 
fuzzy rules describing shape and arrangement of the image segments that correspond 
(/3 [ to visible parts of a vehicle. An extension of the algorithm with set of fuzzy rules 

O ■ defined for different reference images (and various vehicle shapes) enables vehicles 

classification in traffic scenes. The devised method is suitable for application in video 
sensors for road traffic control and surveillance systems. 
^ ■ Preprint of: Placzek, B., Vehicles Recognition Using Fuzzy Descriptors of Image 

' Segments. In: Kurzynski M. et al. (eds.) Computer Recognition Systems 3, Advances 

\^ , in Intelligent and Soft Computing , vol. 57/2009, pp. 79-86. Springer- Verlag, Berlin 

' Heidelberg (2009). The final publication is available at www.springerlink.com 

1 Introduction 

Vehicles recognition is an important task for vision-based sensors. Accomplish- 
ment of this task enables advanced traffic control algorithms to be applied. 
. E.g. recognition of public transport vehicles (buses, trams) allows for priority 

$^ ' introducing in traffic signals control. Recognition of personal cars, vans, trucks 

etc. enables determination of optimal assignment of green time for particular 
crossroad approach. It is obvious that traffic control algorithms using addi- 
tional information on vehicles classes provides lower delays and higher fluidity 
level of the traffic in comparison to less sophisticated control strategies. 

For real- world traffic scenes vehicles recognition is a complex problem. Dif- 
ficulties are encountered especially for crossroads, where queues are formed 
and vehicles under scrutiny are occluded by dynamic or stationary scene com- 
ponents. Vehicles recognition systems have also to cope with influence of ob- 
jects shadows and ambient light changes. 
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In this paper a method is introduced that aUows for vehicles recognition on 
the basis of simple image segments analysis. Matching of segments detected 
in the image with model segments is performed using fuzzy reasoning sys- 
tem. For the proposed method particular image segments are analysed that 
correspond to visible parts of a vehicle. This approach enables recognition of 
partially occluded vehicles. Applied method of segments description includes 
several shape parameters and enables considerable reduction of data amount 
processed by the reasoning system. 

Rest of this paper is organized as follows. Section 2 includes a brief survey 
of vision-based vehicles recognition methods and presents a general design of 
the proposed method. Section 3 includes definitions of segments parameters 
and merging operation. Section 4 describes fuzzy rules designed for vehicles 
recognition. In section 5 implementation details of the fuzzy reasoning system 
are discussed. Section 6 deals with pre-processing of the input data, including 
segments extraction and merging as well as application of vehicle models. An 
experiment results are shown in section 7 and finally, conclusions are drawn. 

2 Related works and proposed method 

Several vision-based vehicles recognition methods have been developed so far. 
All of these methods use various forms of vehicle shape models. Some of 
the models describe shape of entire vehicle body (3-D models); other models 
consider selected shape properties or local features arrangement in the vehicle 
image. Usually operations of vehicle detection and tracking are preliminary 
steps in the algorithm of vehicles recognition. 

In [S] a method is introduced that uses only vehicle dimensions to classify 
vehicles into two categories: cars and non-cars (vans, pickup, trucks, buses, 
etc.). Vehicles models are defined as rectangular image regions with certain 
dynamic behavior. Correspondences between regions and vehicles are recog- 
nized on the basis of tracking results. 

A vehicle recognition approach that uses parameterised 3-D models is de- 
scribed in [3]. The system uses a generic polyhedral model based on typical 
shape to classify vehicles in a traffic video sequence. Using 3-D models par- 
tially occluded vehicles can be correctly detected [6J. However, algorithms of 
this type have higher computational complexity. 

Feature-based vehicle recognition algorithms [7J include edge detection 
techniques, corner detection, texture analysis, harr-like features, etc. On the 
basis of these detection tools the vehicle recognition methods have been de- 
veloped [To] . In [8] a vehicles classifier is proposed based on local- feature con- 
figuration. It was applied to distinguish four classes: sedan, wagon, mini-van 
and hatchback. 

Another approach combines elements of 3-D models with feature-based 
methods. Local 3D curve-groups (probes) are used, which when projected 
into video frames are features for recognizing vehicle in video sequence f3]. 
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This classifier was applied to three classes of vehicles: sedans, mini vans and 
SUV's. 

The method introduced in this paper was designed to recogirise vehicles 
and categorize them into classes that are relevant from a point of view of the 
traffic control objectives. Taking into account impact on a crossroad capacity 
and priority level, five fundamental vehicle classes have to be distinguished: 
personal car, van, truck, bus and tractor-trailer. 

In the proposed approach vehicles recognition is performed by reasoning 
procedure using fuzzy rules [9]. The rules describe shape of a vehicle model and 
allow for level evaluation of similarity between image objects and the assumed 
model. Scheme of the method is presented in fig. 1. The recognition is based 
on description matching of the model segments with segments extracted from 
an input image. Segment description takes into account its geometrical prop- 
erties, shape coefficients and location. This particular data format was applied 
for both model segments (reference image) as well as segments extracted from 
input image. Processing procedure of input image includes segmentation and 
merging of the extracted segments (see sec. 6). This method do not require 
tracking data to recognise a vehicle. The complexity reduction of recognition 
algorithm is achieved due to processing of simplified image description. 



segments 



rules 



vehicle 
model 


selection 


segments 

MS 


induction 


fuzzy 
rules 




► 

segmen- 
tation 


► 

merging 




1 








reasoning 
system 


Input 
image 


segments 
ES' 


segments 
ES 


t 


► 


► 





recognised 
vehicles 



Fig. 1. Scheme of the vehicles recognition method 



Fuzzy rules are inducted on the basis of segments properties determined 
for vehicle model. Rules induction process consists in fuzzyfication of the 
parameters describing model segments MS. Antecedents of the rules take into 
account description of segments MS; consequents indicate degree of similarity 
between input image and the model. 

The segments merging, rules induction and reasoning procedures are per- 
formed using devised representation method of image segments (segments 
description based on selected geometric parameters) . Operations are not exe- 
cuted directly on image data, what is crucial in reducing computational com- 
plexity of the recognition algorithm. These procedures will be described in 
detail in the following sections. 
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3 Segments description and merging operation 

Introduced shape description method for objects registered in an image is 
based on selected geometrical parameters of the image segments. The descrip- 
tion method applied for segments of rofcronco image (model) as well as for 
extracted segments of the input image remains the same. 

Description of i-th image segment is defined by the formula: 

Si = {A, Xi, j/„ xr", j/r", yrl , (i) 

where: Ai - area of the segment, Cj = (xj, j/j) - centre of mass determined for 
the segment, w{Si) = x^^^-x™" - width of the segment, h{Si) = y^<^^ -y^^^ 
- height of the segment. 

Computations of the segments parameters, defined above, are performed 
for coordinate system x-y (fig. 2) that has orientation determined by the model 
orientation in camera coordinate system. 




Fig. 2. Segments merging operation 



The principles of segments merging operation are illustrated in fig. 2. Pa- 
rameters of merged segments are depicted in fig. 2 a); fig. 2b) presents results 
of the segments merging. Formally, the merging operation is denoted by rela- 
tion: 

Sk = Si ^Sj, (2) 

which means that segment Sk is created by merging Si with Sj and parameters 
of its description are computed according to the following formulas: 

Ak-A.+Aj, Xk~ A, A. ' y''- A-\-A- ' 

= min {xr^ , xj^-) , yr" = min {yr", vT^) , (3) 
x^"^ = max (xf , x™"^) , ^/i^"^ = max (yf^", y™"") . 
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The merging operation has following properties that are important for its 
implement ation : 

n M Q a M a n M / Q M Q \ ( n M Q \ M Q f a\ 

i~>i 'Jj — i~>j i~>ij i~>i \>3j >Jk) — 'Jj) >^k- \^) 

Merging operation is used for pre-processing of segments extracted in input 
image. It is necessary for correct vehicle recognizing by fuzzy rules that are 
introduced in the following section. 

4 Fuzzy rules for vehicles recognition 

Fuzzy rules are produced for recognition procedure on the basis of segments 
defined in reference image (model) . As the method was intended to categorize 
vehicles into classes, a separate model and rules are needed for each class. 

Set MS^ includes descriptions of all segments determined for vehicle model 
of class c : MS"^ = {Sj] ,j = l...n(c) Segments extracted from input image 
are described by elements of set ES : ES = {Si} ,i = l...m. 

For every vehicles class a set of classification rules is created including 
three types of rules, connected with different aspects of the segments layout: 
shape rules, placement rules and arrangement rules. 

Shape rules (5) describe shape of segments defined for the vehicle model 
of class c using shape coefficients. They allow for similarity determination of 
segments from MS"^ and BS. 

if Ai is A"- and q{Si) is q{S]) then p{S^) is j, (5) 

where: i = 1...TO, j = l...n{c) and q{Si) = w{Si)/h{Si) is shape coefficient. 

Placement rules (6) describe mutual placement of the segments. Using 
tlicKC rules each pair of segments from ES is processed. It is performed by 
comparing the relative location of their mass centres (defined by [dx, dy] vec- 
tor) with the mass centres arrangement of the model segments (ji,i2)- 

if dx{Si, , Si, ) is d~x{S;;^ , S% ) and dy{Si, , Si, ) is dy(5;^ , S% ) 

and p{Si,) is j2 then d{Si^,S^J is (ji, ^2), (6) 

where: ii,i2 = l...m, ii 7^ 12, ji = 1, j2 = 2...n(c), dx{Si,Sj) = Xi — xj, 
dy{Si,Sj) = Vi - yj. 

The spatial arrangement rules (7) take into account placement of all model 
segments. Both the segments shape similarity and segments locations are 
checked. It is performed using results of the previous reasoning stages that 
exploit (5) and (6) rules. 

if ^(5*,) is 1 and d(5,,S'2") is (1,2) and d(S'„ S*^) is (1,3) 

and ... and d{Si, S!^^^^^) is (l,n(c)) then class is c, (7) 

where: i = l...m. 
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The tilde symbol was used in rules definitions (5) and (6) to indicate fuzzy 
sets having trapezoidal membership functions. The membership functions are 
determined for specific values of model segments parameters. 



5 Reasoning system implementation 

A registered vehicle is recognised using fuzzy reasoning system with base of 
rules that are defined in the previous section. Input data of the reasoning 
system is fuzzified into type-0 fuzzy sets (singleton fuzzification) . The system 
uses Mamdani reasoning method and averaging operator (arythmetic mean) 
for fuzy sets aggregation [T]. Due to these assumptions, the membership func- 
tions for consequents of rules (5) - (7) are computed according to the formulas 
(8) -(10). 

In the first stage of the reasoning procedure a membership function is 
computed for each segment Si that determines its similarity to particular 
segments Sj of the model. 



Z I J ^ 



i — l...m,j = l...n{c). (8) 



In the second stage another membership function is evaluated to check if 
the segments arrangement in the image is consistent with the model definition: 



1 



(9) 



where: ii = l...m, 12 = l.-.m, ii ^ 12, ji = 1, j2 = 2...n{c). 

At last, the third membership function determines similarity level of the 
object recorded in input image and vehicle shape model of class c: 



fJ-ciassic) = max ■ 



1 



n(c) + 1 



(10) 



where i = l...m. 

The class number of recognised vehicle is a product of the defuzzification 
of function (10). It is determined by the maximal membership method. 



6 Processing of input data 

Input data of the vehicle recognition algorithm (fig. 1) consists of descrip- 
tors computed for both segments ES detected in the input image as well as 
segments MS, selected on the basis of the vehicle model. 
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Segments ES' in the input image can be extracted using various segmenta- 
tion methods. In the presented approach background subtraction, edge detec- 
tion and area fiUing algorithms were appHed for this task [5]. Thus, segments 
£5" correspond to regions of input image that are bounded by edges and do 
not belong to the background. 

Processing procedure of input image includes merging of the extracted 
segments ES' into segments ES, that match better with shape of the model 
MS. The segments merging is motivated by assumed fidelity level of the model, 
which does not take into account minor parts of vehicle like headlights or 
number plate. Set £S" of extracted segments is transformed into ES. This 
operation uses threshold value r of similarity between merged segments Si 
and model segments Sj: 

ES ={S,^ M{PS{) -.BS.&MS: fip^g,) (j) > r} , (11) 

PSi = {Sik}, k ~ 1...Z is a set of extracted segments PSi C ES and M(P5'i) 
denotes the merging operation on set PSf. M{PSi) = Sn ^'^ Si2 ^...^^Si^. 

The rules induction procedure requires parameters determination of the 
reference image (model) segments. A reference image description (set MS) is 
generated on the basis of three-dimensional (3-D) vehicle shape model that 
describes faces arrangement of a vehicle body [2]. This model is transformed 
into 2-D model, for defined locations of the vehicle and camera. Thus, the 2-D 
model establishes a reference vehicle image of a given class that is located in 
a specific place within the scene. Faces of the 3-D model, projected on image 
plane, defines segments AIS of the model. The vehicle model has to be defined 
for each vehicles class that is taken into consideration by the recognition 
procedure. 

7 Experimental results 

The proposed vehicles recognition method was tested using number of images 
selected in video sequences of traffic scenes, where vehicles of different classes 
have been recorded. Furthermore, synthetic traffic images were utilised for 
vehicles queue modeling in performance analysis of the method. 

The experiments of vehicle class recognition were performed using vehi- 
cle models for five classes (personal car, van, truck, bus and tractor-trailer). 
Segments determined in vehicles models were matched with those extracted 
from input images. This task was executed by applying fuzzy reasoning sys- 
tem described in sec. 5. Examples of the experiment results are presented in 
fig. 3. It includes input images and vehicle models marked with white lines. 
The models are displayed corresponding with recognised class of a vehicle, 
identified by maximal value of function fXciass (eq. 10). For particular cases 
depicted if fig. 3 the recognition results were obtained as follows: a) personal 
car 0,44; b) personal car 0,51; c) personal car 0,38; d) bus 0,37; e) truck 0,31; 
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personal car 0,41; f) tractor-trailer 0,35. The above numbers denote maximum 
of ^ciass for each example. 




Fig. 3. Examples of recognised vehicles 



The overall result of the experiments indicates that for nearly 90% of test 
images the proposed vehicle recognition method provides correct classification 
results. However, the results strongly depend on correctness of the segments 
extraction in input images. 

8 Conclusion 

A fuzzy description method of image segments was introduced. The method 
was implemented for automatic recognition of vehicles recorded in image data. 
This implementation was based on fuzzy reasoning system with rules describ- 
ing properties of image segments. 

Experimental results confirmed that the proposed method is effective to 
vehicle recognition. It was demonstrated that the system can categorize vehi- 
cles into five classes. It should be noticed that low complexity of the proposed 
image description makes the method suitable for application in video sensors 
for road traffic control and surveillance systems. 
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